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(54) MULTI-MEDIA INFORMATION TRANSMITTING SERVER 

(57)Abstruot: 

PROBLEM TO 06 SOLVED: To provide a server. which does not transmit useless data to a client 
when special reproduction is performed, such as fast-forwarding or rewinding, in streaming 
transmission. 

SOLUTION: A multi-media information transmitting sorver is provided with a transmission control 
prooc-^ihtf part 14 which retrieves a reproduction start possible point storage part 12 based on 
reproduction control information which is transmitted from a client terminal 2, calculates a 
reproduction possible point being the nearest to a reproduction desired point end, then, transmits 
multr- media information from the calculated reproduction possible point. Reproduction oorrtrol 
information is information corresponding to a reproduction point desired by the client terminal. 
The storage part 1 2 stores the position of a multiplex packet comprising a frame (l-Frame) whioh 
is Included in video information and performed in-frame encoding or the number of the multiplex 
packet together with reproduction time information. 
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* NOTICES * 

JPO and INPIT are hot responsible for any 
damages caused by the uae of this translation. 

1. ThiB document has been translated by computer. So the translation may not reflect the original preolsoly. 

2. **** shows the word whioh can not be translated. 
3in the drawings, any words are not translated. 



[Claim<s>] 

[Claim 1]A multimedia information transmission server device which accumulates an image and multimedia information which e sound haa multiplexed 
and transmits the information accumulated to a client terminal, comprising: 

A point storage part a store whioh memorizes a point in multimedia information whioh oan be reproduction started end whioh oan be reproduction 
started. 

A reproduction control means which receives reproduction control information from said client terminal, end transmits information from a refreshable 

point. 

[Claim 2]Said point storage parts store which can be reproduction started memorizes a position of a multiplex packet including a position of e frame 
which ia oontaihed In video Information multiplexed to said multimedia information, end whioh was formed into the frame inner oodo as a point which can 
be reproduction darted, and. The multimedia informetion transmission server device according to claim 1 roleting with regeneration time corresponding 
to a position of a aid multiplex packet said point whioh oan be reproduction started, and memorizing it 

[Claim 3]Seid reproduction control means searches a point which said point storage parts store whioh oen be reproduction started memorizes based on 
reproduction control Information from said client terminal and whioh can be reproduction started. The multimedia information transmission server device 
according to claim 1 transmitting multimedia information with a multiplex pdoket as the starting point including a point whioh was acquired as a result of 
search, and which can be reproduction started. 

[Claim 4]Said point storage parts store which can be reproduction started memorizes a number of a multiplex packet including a position of a frame 
which is contained in video information multiplexed to said multimedia informatioa and which was formed into the frame inner code as a point which can 
be reproduction started, and. The multimedia information transmission server device aooording to olsim 1 relating with regeneration time correaponding 
to a number of said multiplex packet said point which oan be reproduction started, and memorizing it. 



CLAIMS 



m 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[O001] 

* [Raid of the Invention]Thie invention roletea to the multimedia information transmission server device which carriea out streaming transmission of the 
multimedia information which the image and the sound multiplexed. 
[0002] 

[Description of the Prior Art]As one gestelt of multimedia information transmission whioh transmits a sound, an image, data, etc., multimedia information 
is beforehand accumulated in the server apparatus, and there are some whioh transmit information according: to the demand from a Client terminal. 
Under tha present circumstances, no o option of information and the method of performing reproduction in parallel exist by starting reproduction, before 
reoeiving all of the method of starting reproduction after receiving all desired multimedia Information to the client terminal side, and desired multimedia 
information. Especially the latter method is generally called streaming transmission and streaming reproduction. 

[0003] Generally, original information, such as on image and a sound, is not sotuaJly cent from data volume becoming very large in a form as rt is at the 
fcime of transmission of multimedia information. Therefore, it is common to compress and transmit by a certein technique and to develop at the time of 
rcoaption. If en image is compered with a sound, since it is very large compared with audio it, the amount of information of the image is made 
indispensable [ compression of video information ]. 

[0004]Although various things exist in the compression method of video information, things, suoh as MPEG-2 and MPEQ— 4, are used as a standard 
compression method. It ib possible to uso tho method of it not only coding respectively the frame Information which is the original information of an 
image, but coding the following frame using the information on a certain coded frame, as these features. This uses the relative redundancy of the video 
information in a time base direction. 
The big duty is achieved on the information compression. 

[0005]For example, in the compression using MPEG-4» a certain frame information being ooded independently (this — I frame: — referred to as intra 
frame), ond the following frame, only the result of having calculated difference based on tho information on this t frame being ooded (this — p-framos: - 
- referred to as predictive frame), and further the following frame. By oarrying out baaed on the information on these p frames, and repeating the same 
processing as the information oompression of the relative redundancy in the time-axis method ib oppressed and carried out 
[0006] Here, since p frames have coded only difference information wrth a previous frame, the amount of information per frame becomes small. On the 
other hand, with tha ( frame, shoo it has ooded only based on the information on an applicable frame, the amount of information per frame becomes 
large, Therefore, when making a transmission rate small with equivalent quality, It oan be said that it will lead to Improvement in imago quality if a 
direction with few frames which should be coded as much as possible with the I frame lets the whole pass. 

[0007]Now, since information is constituted from the independent frame by the I frame If the case where it reproduoos fromthe middle of multimedia 
information is taken into consideration, reproducing from the I frame Is possible. On the other hand, rt is impossible to start reproduction from p framo* 
in p frames, since it is coded based on the difference inform ation from a former frame. 

[0008]Therofore, when reproducing from the middle of multimedia information and the point where a user asks for reproduction ia ooded by p frames, a 
normal repeat display will be carried out until the following I frame in multimedia Information appears. If this is seen for a user. It can become a 
dissatisfied basis in that It Is not reproduced although it pointed to reproduction. In the point of transmitting unreproduoible information via a network, a 
user is also charged to useless information and oan oa(l It the situation whioh ia not preferred for the side which receives service. 
[0009] In the streaming reproduction in the conventional system. In the server apparatus which received the demand of request multimedia information 
from the client terminal. It was only transmitting the demanded information to a olient terminal, receiving the raooived multimedia information by the 
olient terminal side on the other hand, and reproducing, and tt was difficult to perform halt and a rapid traverse and epeciaf reproduction like rewinding. 
[0010] Alt hough it can respond by using a non-standard protoool between a server apparatus and a client terminol about suoh special reproduction, In 
these days when various platforms oxret, using the protoool which can be used only with a speoifto server apparatus and a specific olient terminal had 
Forced it inconvenience for the user. 
[0011] 

[Problem(s) to be Solved by the InventionJAs mentioned above, in the conventional multimedia information transmission. SInoe the refreshable point and 
the point wanting [ reproduction ] were not in agreement at the time of the special reproduction in a streaming transmission type, from tho point 
wanting [ reproduction ] before tha refreshable point could not but look at the picture without 0 meaning for the client terminal like the last picturo or 
the black picture. 

[0012]$iripe the data of a boforo [ from the point meaningless for a client terminal wanting / reproduction / a refreshable point ] was transmitted, 
useless transmission data volume occurred and the traffic which should pay a client had been influenced 

[0013]When the purpose of ttiis invention was made in view of the above -me ntio nod situation and performs special reproduction called the rapid 
traverse and rewinding In a streaming transmission type, there is in providing the multimedia information transmission server device which does not 
transmit useless data but can transmit refreshable data. 
[0014] 

[Means for Solving the Problem]ln order to attain tho above-mentioned purpose, a multimedia Information transmission server device of this invention, 
A point storage parte store whioh accumulates multimedia information whioh an image and a sound have multiplexed, transmits the irrfbrmation 
accumulated to a client terminal, end memorizes a point in multimedia information which can be reproduction started and which can ba reproduction 
started. Reproduction control information from seid client terminal woe reoeived. and rt had a reproduction oontrol means whioh transmits information 
from e refreshable point Hero, reproduction control information Is information corresponding to a reproducing point for whioh a olient terminal asks, end 
said reproduction oontrol means searches said point storage parts store whioh can be reproduction started, it computes s nearby refreshable point of 
the point wanting [ reproduction ]. and transmits multimedia information from a computed refreshable point A refreshable point in multimedia 
information is a position of a frame which is contained In video information In multimedia Information and which was formed Into the frame inner code, 
Le., a multiplex paoket containing {-Frame, or a number of a multiplex packet 

[0015]Since it becomes possible to start transmission of multimedia Information from a reproducing starting point whioh spproaohed a point wanting 
[ reproduction ] by having adopted the above-mentioned composition, When performing special reproduction, such as a rapid traverse end rewinding. 

also in a streaming transmission type, transmitting uocloso data to a client is lost 
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[0018] 

[Embodiment of the Invoniion]Hereafter t an embodiment of the invention is deeoribod with reference to drawings. 

COO 171 Drawi ng 1 is a block diagram showing tho composition of the multimedia information transmission systems for which the multimedia information 
tranHmiatiion server device of this invention is used. As shown in drawing 1 . the multimedia information transmission server device 1 and the multimedia 
information receiving client termJnef 2 exist vie a network. 

[00lB]The multimedia information transmission sorvor device 1 is provided with the multimedia infbrmetion accumulating part 11 (by a diagram, it ta 
wrttton or. "MM information storage'), the refreshable point management data base 12 (by a diagram, it Is written ea the refreshable point management 
DB) and the control information rooeiving processing part 13. end the transmission-control treating part 14. The multimedia information re oaiving client 
terminal 2 is provided with the multimedia information receiving processing part 21 (by a diagram, it ic written as "MM information reception treating 
part"), the reproduction control input processing part 22, the video information outputting part 23, the speech Information outputting pv* 24. and the 
reproduction control method indicator 25, 

[001 9] Multimedia information with structure as ehown in drawing 2 i s accumulated in tHe multimedia information accumulating part 11. By drawing 2,_one 
video stream and one audio stream are multiplexed and the example which generates one multimedia stream (inoide of a figure multiplexed stream 
and notation) is shown. The packet in which Al. A2. and A3— coded the audio stream for the packet In which VI in drgwinff % V2. and V3 coded the 
video stream par frame per frame is shown, respectively. 

[0020]ln the coded vidso stream, intra-frame (l-Frame) one coded only using the information in a frame and the frame (P-Frame) coded using the 
information on the frame coded before are Intermingled. Since P-Frame can oompress relative redundancy using the information on the frame coded 
before, it aan make the information after coding smaller than I-Frame. In the example of a^wjng_2. [-Frame. VZ, and V3 are made into P-Frame for VI. 
An audio stream presupposes that It is coded as length of immobilization in fixed time. When reproducing the video stream coded in this way. the 
information on [-Frame booomes indispensable. And let the head of I-Frame in a stream be a reproducing starting point 
[002l]On the other hand, about an audio stream, since it does not code uaing inter-frame information, he does not need to be consoious of a 
reproducing starting point in particular. 

[D022jThe example of composition of the multimodia stream whioh multiplexed an aforementioned video stream and audio stream Is shown in the middle 
oF drawina 2, The header whioh shows how the multiplexed stream wm\pt\^ a packet unit and eaoh etreem of video and a sound haa multiplexed rt at 
the head of each packot shall have multiplexed the packetized voloe and the video paoket by the suitable method to the payload part following a 
hoader.ln the example oF drawing 2 . VI paoket whioh is [-Frame was divided and multiplexed to two or more multiplex paokets M1 and M2. and V2 
packet ie multiplexed to M3. t 
[0023]Thu refreshable point database 12 detects the position of the refreshable point in the above-mentioned multimedia information, lb., the l frame. 

and has a function to memorize, 

[0024]Thu oontrol information receiving prooossing part 13 has the function to receive the reproduction control information from a oliBnt By this 
embodiment, the POST mathod specified by HTTP is used as an information transmission means from a client Of course, as long as it is a mesne to 
transmit reproduction control information from a client to a server, what kind of means may be used. 

[0025]Ba«ed on the control request from the oontrol information receiving proceaaing part 13, the transmission-aontrol treating part 14 detects a 
reproducing starting point using the information on the database 12, and has a function whioh sanda out the information accumulated in the information 
storage part 1 1 from a reproducing starting point. 

[0026]On the other hand, the multimedia information regenaretion part 21 in the multimedia information receiving client terminal 2 has the function to 
separate into eaoh information on video and a sound the multimedia information received via the network from the multimedia information transmission 
oerver device 1. Tho separated video Information ie played in the video information outputting part Z3, and the separated apaooh information ia played In 
the speech information ©inputting part 24. 

[0027]The reproduction control method indicator 25 has a function whioh displays information for a usar to oontrol a regeneration method For example, 
in order to enable reproduction control directions of a reproduction start, a reproduction stop and a halt a skip, etc. to a user, the button image 
equivalent to each function is displayed. A slide bar is displayed as a function for enabling reproduction from arbitrary positions. The display example is 
shown in drawing^. 

[0028]Tho reproduction control input processing part 22 receives the oontrol method whioh the user apeorfiod based on the reproduction control 
method indicator 25. and haa a fonotion whioh tranemite the directions noeded to the multimedia information transmission server devioe t. 
[0029]Hereafter f the operation of the multimedia information transmission server device 1 and the multimedia information receiving client tormina! 2 
based on the above-mentioned composition is explained. 

[0030]Now. the user of the multimedia information receiving client terminal 2 reoeives the multimedia stream accumulated In the multimedia information 
transmission server devioe 1 , and streaming reproduction is considered as a method of reproducing. 

[0O31jWhen streaming reproduction is ohosen, before reaeiving tho whole multimedia Stream, reproduction oan be Started with the multimedia 
information receiving client terminal 2. Therefore, since the necessity of memorizing the wholo multimedia stream doea not ocour. the multimedia 
information receiving client terminal 2 oan make a storage area small. 

[0032]The multimodia information receiving client terminal 2 divides into each information on video and a sound the multimedia stream which received 
from the multimedia information transmission aerver devioe 1 in the multimedia information regeneration part 21. The separated video information is 
played in the video information outputting part 23, and the separated speech information is played in the speech information outputting part 24. 
[0033]Here, when the overall length of a multimodia stream has become clear beforehand in the ease of reproduction, the place under reproduction can 
be shown in the eiida bar shown in the reproduction control method indioator 25. The example of the reproduction place display in a slide bar is shown 
in drawing .4. 

[0034]In a|rewint4,.the example which reproduces the stream whose overall length is 600 seconds is ehown. In this case, the corner point A oF a slide 
bar show« the head of a stream, and the corner point B shows the end of a etroam. When a reproducing point is in the position for 1O0 seconds from a 
start, in order to mean reproducing 1/6 of the whole when regeneration time from the corner point A to the corner point 0 is made into 600 eeconds, 
1/6 of the points of the whole slide bar are displayed as a reproducing point from the oorner point A. Similarly, when tho position for 200 seconds ia 
being reproduced, 2/6 of the points of the whole slide bar are displayed as a reproducing point from the comer point A on a elide bar. 
[0035]Hore, when a reproducing point is in the position for 500 seconds, suppose that a user wants to reproduce from the point for 100 seconds. 
Horoaftor, this ia called "skip reproduction processing" At this time, a user directs to reproduce from the position for 100 seconds to the reproduction 
control input part 22 by shifting the slide bar of the reproduction control method treating part 25 in the position for 100 seconds. That is, it directs to 
skip to th*3 position for 1 00 sooonds by skip reproduction prooossing. 

[00 3 9] In the reproduction control input processing part 22. recognition of reproducing from a point for 100 seconds will transmit the reproduction 
oontrol information shown in drawing 5 t o the multimedia information tranam lesion server device 1 as Information on the purport "ft skips to a point for 
1 00 secondB." 

[0037l DniWing 5 i s an example of ra production oontrol information. As 6hown in drawing 6. stream "regeneration time" (by a diagram, it is written a a 
"time") or a "packet number" or. and a "position" oan be used as information on a skip placo. This means that the reproduction point recognized in tho 
reproduction control input part 22 may be managed by any of regeneration time, a paoket number, or a stream position. The "judgment method" in 
drawing 5 is mentioned later. 

[0038]By receiving / analyzing the transmitted reproduction control information, the control Information receiving prooossing part 1 3 of the multimedia 
information transmission server device 1 detects that the demand from a client is "skipping to a point for 100 seconds", and tells that to the 
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transmission-control treating part 14. 

[0039]lf the given information "which is skipped to a point for 1C0 seconds ie reoeived, the transmitting processing of e multimedia stream under 
tranemieeion will be interrupted for the transmission-control treating part 14, and it will be searched for a transmission start point baaed on ttia 
Information directed from the client. 

[0040]Horo. the composition of the multimedia stream in this embodiment is shown to ptowin^B, prswing 6 shows the composition of the whole stream 
which needs the regeneration time for G0Q seconds. The stream comprises a packet unit which tho video streem and the audio stroam multiplexed 
appropriately. Furthermore, from near the 100-aeeond point which ia a skip place (i.e., a 90-socond point), drawing 6 shows the paoket composition of 
1 10-eecond point, and it shows the pleoe where I-Frame is coded among the video streams in a paoket That 19, the video atream oOded by the packet 
of a point and the packet of S 107-eeoond point by [-Frame for 09 seconds exists. All the video streams contained in other multiplex packets shall be 

oodod by P-Frame. „ rt 

[0041 ]lf it is in this embodiment the transmission-control treating part 14 which received the information skipped to a point for 100 seconds 
interrupts transmitting processing of a multimedia atream. and aearohes for o transmission start point based on the information dlrootod from the client 
The position of the packet containing I-Frame which is a refreshable point Is detected by specifically oomparing with a skip place point the refreshable 
dot data stored in the multimedia refreshable point database 12. 

[0042}The example of the information stored In the multimedia refreshable point database 12 ia shown in d rawing 7. prawing 7 shows the position from 
the regeneration time of a packet number and an applicable paokot number, and the stream head of en applicable paoket whioh contains I-Framo as e 
refreehablo point It io characteristic here that match with the position from the stream head Of a packet number and an applicable packet containing I- 
Frame, and regeneration time is memorized as data. 

[0043]|n d rawing 7 . when skipping to a point for 100 seconds, processing which searches a noarby refreshable point from a database is performed If the 
point of a skip place is in agreement with a refreshable point it is possible to make the point into a refreshable point but to be inharmonious, it is 
necessary to search for the optimal refreshable point from the specified skip place. Here, as conditions for search, it is considered as what the 
refreshable point in front of the specified skip place point is chosen for." tn this case, the regeneration time field will be compared with a skip place 
point and a point will be choson for 99 seoonds of the data registered. Therefore, what is necessary is just to transmit the atream from a 792Q00-byto 
point from a head, if the packet of the packet number No. 990 end expression ere changed. 

[0044]By performing this processing, the stream after a 99-eecond point will be received by a multimedia receiving client Since the video atream coded 
by tho packet of the point by I-Framc for 99 seconds exists, it becomes renewable immediately. 

[0045]On the other hand, what "the refreshable point nearest to the specified skip place point is chosen also for" is possible as another search 
oonditiori. This is a case where the item of the "judgment method" in the reproduction control information of drawing 3 has become these days. If the 
oase where a point is chosen for 104 seconds as a skip place point is token for an examplo, the regeneration time field will be oompared with a skip 
plaoe point and the refreshable point in front of a skip pjaoe point and the refreshable point Just behind a skip place point will be extracted. 
[0046]In this example, a point will be extracted for 99 seconds as a last refreshable point, and a point will be extracted for 107 seoonds as a next 
refreshable point tf the time lag of a skip place point and these two refreshable points ia calculated, it will turn out that the refreshable point of 4 
seconds and an immediately after has the difference amone 3 seconds as for the last refreshable point and it will be oolled for that the thing 
refreshable point thereby nearest to a skip place point is a 107-second point Therefore, what is necessary Is Just to transmit tho stream from an 
856000-byte point from a head, if the paoket of the packet number No. 1070 and expression are ohanged in this case. 

[O047]The sesrch condition quoted here Is an example and it doos not core about establishing other conditions at all. Ho may leave selection of 
conditions to the server apparatus side, a function preselection capability mey be given to a olient and it may make it choose whioh oonditions to be 
usod wfth 0 user's directions. This oan provide the item of a "judgment method" In the reproduction oontrol information shown in drffiWfrff 5 mentioned 
above, and can realize it by making a user choose. Although tho embodiment mentioned above showed the example whioh searched for tho optimal 
refreshable point amone reproduction control information using time information, the optimal refreshable point may be searched for by the packet 
number or a stream position, 

[0048] In addition, modification implementation various in the range whioh does not deviate from the gist of this invention is possible. 

[0048] . . 

[Effect ot the lnvention]According to the muWmodla Information transmission aorver device of thia Invention, as explained above, when performing 
Special reproduction called the rapid traverse and rewinding in a streaming transmission typo, useless deta cannot be transmitted to a client but 
refreshable data can be transmitted. 
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* NOTICES * 



JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 



1, Thie document has boon translated by computer. So the translation may not roflcot the original prooisely. 

2, **** shows the word which can not be translated. 
3Jn the drawings, any words ore net translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawing] 

[Drawin g JjTho blook diagram Showing tho oompoertion of the multimedia information transmission systems for whioh tho multimedia information 
transmission server device of this invention is used. 

LQrawjng 2]The figure showing the structure of the multimedia Information ao cumulated in tha multimedia information accumulating part 1 1 In a 
multimedia information transmission server device. 

[Drawing 3]Ths figure showing the display example in the reproduotion control mothod indicator 25 in the multimedia information receiving client 
terminal 2. 

(P/.fittift&,4lThe figure showing tho display example of the reproduction control method indicator 25. 

[Drawing 5] The figure showing the composition of the reproduction control information supplied from the reproduction control input processing part 22 
to tho multimedia information transmission server device t. 

[Drawing fl]The figure showing the composition of tho multimedia stream in this embodiment. 

[Drawjng 7lThe figure showing the example of the information stored in tho multimedia refreshable point database 12 In the multimedia information 
transmission server device 1 . 
[Description of Notations] 

1 ... Multimedia information transmission server device 

1 1 ... Multimedia information accumulating part 

12 Refrashoble point management date base 

13 Control information receiving processing part 

14 ... Transmission-control treating part 

2 Multimedia information reoeiving client terminal 
21 ... Multimedia information receiving processing pert 
11 ... Reproduction control input prooescing part 

23 ... Video information outputting part 

24 ... Speeoh information outputting part 

25 ... Reproduotion oontrol method indicator 
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